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The notion of group entropy is proposed. It enables to unify and generalize many different defini- 
tions of entropy known in the literature, as those of Boltzmann-Gibbs, Tsallis, Abe and Kaniadakis. 
Other new entropic functionals are presented, related to nontrivial correlation laws characterizing 
universality classes of systems out of equilibrium, when the dynamics is weakly chaotic. The asso- 
ciated thermostatistics are discussed. The mathematical structure underlying our construction is 
that of formal group theory, which provides the general structure of the correlations among particles 
and dictates the associated entropic functionals. As an example of application, the role of group 
entropies in information theory is illustrated and generalizations of the KuUback-Leibler divergence 
are proposed. A new connection between statistical mechanics and zeta functions is established. In 
particular, Tsallis entropy is related to the classical Riemann zeta function. 
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I. INTRODUCTION 

In many physical contexts, as well as in economy, bi- 
ology and social sciences, the nature of the correlations 
among the parts or the subsystems constituting a given 
system is crucial for the understanding of the underlying 
dynamics. A possible example is offered by the present 
international economical context. Indeed, the simplify- 
ing hypothesis of microeconomical independence in lo- 
cal or national markets appear to be inadequate to de- 
scribe the evolution of the present economical scenario: 
the strong and unexpected correlations that the crisis has 
generated among previously unrelated economic and fi- 
nancial entities make inadequate the foresight of models 
based on this hypothesis (for a general perspective see e.g. 
the monograph I]). Many experimental observations in 
condensed matter physics, nuclear physics, astrophysics 
as well as in several fields of social sciences reveal the 
need for a general formulation of statistical mechanics 
that might proceed from the kind of correlation experi- 
mentally observed, and deduce coherently the associated 
thermostatistics. 

Nowadays, the celebrated Boltzmann-Gibbs (BG) sta- 
tistical mechanics is recognized as the appropriate the- 
ory to describe the thermodynamics of a very large class 
of physical systems, ubiquitous in nature, at thermal 
equilibrium. A paradigmatic example is the case of sys- 
tems with short-range interactions and short-time mem- 
ories. Also, BG statistical mechanics has been success- 
fully adopted in the description of critical phenomena 
and in nonequilibrium statistical mechanics, when the 
ergodic or the chaotic hypothesis are assumed 

However, there are frequent situations when at least 
some of the basic assumptions of the BG theory are vi- 
olated (for instance when ergodicity is not assumed). In 
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[3 , the approach called nonextensive statistical mechan- 
ics was introduced to extend the applicability of the stan- 
dard theory to these "pathological", but still common 
situations. 

In most of the cases when a weak chaotic regime is 
observed, e.g. in several systems exhibiting long-range 
interactions, scale invariance Q, multifractal structure, 
etc., and recently, in hadronic physics [sj, the nonexten- 
sive approach offers an adequate theoretical framework 
for the comprehension of the thermodynamics of the un- 
derlying dynamics [B]. A huge literature exists on this 
theory and its multiple applications in science (for a reg- 
ularly updated bibliography, sec 10]). However, it should 
be noticed that the kind of correlation between different 
subsystems contemplated in this approach, although very 
relevant for the applications, is just one of the many pos- 
sible types we can hypothesize. 

In this work, we address the following question: there 
exists a unified theoretical framework, suitable for con- 
structing generalized entropies and related thermostatis- 
tics for a wide class of systems out of equilibrium, cor- 
related in a nontrivial way? We provide an affirmative 
answer, by extending the nonextensive approach in order 
to englobe a very general class of correlation laws among 
subsystems of a given system. Under suitable hypotheses, 
to each choice of the correlation law, it corresponds an 
entropic functional and a related microscopical descrip- 
tion of the dynamics. From this point of view, it is the 
correlation that dictates the thermostatistics and the cor- 
rect entropy to be used, and not viceversa: the entropy is 
not postulated, but its functional form emerges naturally 
from the class of interactions we wish to consider. 

Our theory reposes on the notion of universal formal 
gro up. Formal groups have been proposed by Bochner 
[12| . with the aim of generalizing Lie groups and algebras. 
In the last decades, the theory of formal groups has been 
widely investigated for its crucial role in many branches 
of pure mathematics [l3[, [l4[. It is especially relevant 
in algebraic topology (cobordism theory [Tsj, theory of 
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genera [l^, homology theo ry JTtI ) and in the theory of 
eUiptic curves [ll]. In [T9j-|2ll|. formal groups have also 
been used to construct a generalization of the Bernoulli 
polynomials and of the Riemann zeta function. 

We will show that each realization of the Lazard uni- 
versal formal group enables us to define a possible uni- 
versality class of statistical systems, in terms of the cor- 
relation law satisfied by the random variables associated 
to the considered system, and describing its observables. 
Each correlation law in turn defines a specific quantum 
calculus. Also, for each class we can introduce in a natu- 
ral way an appropriate entropy of trace-form type, con- 
structed by using the finite operator calculus [22], and 
analyze the corresponding generalized nonextensive sta- 
tistical mechanics. Important physical constraints, like 
concavity or Lesche stability, are also considered, since 
they are indispensable in order to have physically satis- 
factory entropies. 

It should be noticed that the meaning of " universality" 
in our context presents some similarities with the usual 
one, as referred to critical phenomena. In any case, we 
will not be concerned with critical phenomena in this 
work. 

The physical need for such family of new entropies is 
evident, for instance, from the physical example of a sys- 
tem of N interacting over-damped particles, recently pub- 
lished [Tlj . The entropy for this system, which is neither 
Boltzmann's nor Tsallis'one, falls in the class of universal 
group entropy and can be easily studied in our formalism. 

However, the group entropies are not exclusively de- 
signed for physical purposes. Indeed, due to the ubiqui- 
tous role of the notion of entropy in modern science [23| , 
the possible applications of the proposed construction are 
manifold. For instance, another non trivial application 
of our entropic functionals emerges in the context of In- 
formation Theory. We will show that these entropies 
provide a class of information measures, including the 
Shannon information measure as a particular case. Also, 
we propose a generalization of the Kullback-Leibler di- 
vergence, that allows us to define a new set of tests mea- 
suring the difference between two given probability dis- 
tributions. 

A further result is the connection we establish between 
statistical mechanics and number theory. This fascinat- 
ing topic has an intriguing history, dating back to the 
70's with the works of Montgomery and Odlyzko, relat- 
ing the Gaussian unitary ensemble with the zeros of the 
Riemann zeta function ((s) 2j|. In 25|, it has been 



shown that the Riemann zeta function is the canonical 
partition function of a free bosonic gas. Also, recently 
the zeros of ({s) have been related to Landau levels [2^] 
for a charged particle on a planar surface in an electric 
potential and uniform magnetic field. A quantum me- 
chanical model whose spectrum is the sequence of prime 
numbers has been proposed in ^2?] . 

Our construction is quite different from other number- 
theoretical approaches to statistical mechanics. Under 
appropriate hypotheses, with a class of universality we 



can associate a zeta function, constructed by using the 
same realization of the Lazard group used to define the 
corresponding entropy. The family of zeta functions con- 
sidered here have been introduced in (l9| and further 
studied in The first nontrivial case is the Tsallis 

class, which corresponds to the celebrated Riemann zeta 
function. 

We mention that other generalizations of nonextensive 
statistical mechanics are known in the literature, based 
on different kinds of deformations of logarithmic and ex- 
ponential functions (see, for instance, 28 1, [l^. Chap- 
ter VI of and references therein). The present one 
also differs from the superstatistics scenario proposed in 
[sOl- Our approach aims to unravel both the group and 
number-theoretical content of the notion of entropy, and 
seems new. Also, it is constructive: all the entropic func- 
tionals are obtained in a explicit form. 

Work is in progress on a quantum version of the the- 
ory developed here [3l|. In particular, group entropies 
emerge as natural measures in the Hilbert space of the 
states of a multipartite system as entanglement measures 

The paper is organized as follows. In Section 2, we 
discuss a family of logarithm-type functions, obtained in 
the context of finite difference calculus, along with the 
formulation of G. C. Rota. In Section 3, the notion of 
group entropy is introduced, based on the previous con- 
struction. In Section 4, the universality classes related 
to group entropies are constructed; their thermodynamic 
properties are studied in Section 5. In Section 6, we 
develop a measure-theoretic setting for interpreting the 
group entropies as information measures. In Section 7, 
the group entropies are associated with zeta functions. 
Some open problems are discussed in the final Section 8. 



II. DIFFERENCE OPERATORS AND 
LOGARITHMIC FUNCTIONS 



In order to construct generalized thermostatistics, and 
the related entropic functionals, we start introducing a 
family of logarithmic functions, obtained from suitable 
representations of certain finite-difference operators. For 
the sake of clarity and to offer a self-contained exposition, 
some basic concepts are reviewed. The mathematical ap- 
paratus is kept to a minimum. 

Let a space of sufficiently regular functions of a real 
variable possible choice is, for instance, a Banach 
algebra of functions. Let us denote by T the shift op- 
erator, whose action on a function / G H is given by 
Tf(x) = f{x + a). Here cr is a real parameter, whose 
absolute value can be interpreted as the width of a reg- 
ular, equally spaced lattice of points £. We essentially 
adopt the formalism of [2^ . 

In order to define the class of entropic functionals of in- 
terest for this work, we will consider operators expressed 
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as finite Laurent series in shift operators 



1 



Ar = -y knT\ l,m£Z, l<m, m-l^r, (1) 



71 — 1 



wliere {kn} are real constants sucli that 



kn = 0, ^ nkn = c. 



(2) 



n=l 



n—l 



and km ^ 0, fc; ^ 0. We choose c = 1, to reproduce 
the derivative D in the continuum limit, when the lattice 
spacing a goes to zero. 

Definition 1 A difference operator of the form {Ip, 
which satisfies equations 0), is said to he a delta operator 
of order r, if it approximates the continuous derivative up 
to terms of order . 

As eq. ([T]) involves m — I + 1 constants fc„ , subject to 
just the two conditions we can fix all constants /c„ by 
choosing m — I — 1 further conditions. A possible choice 
is, for instance, to set 



J2\nfkn^Ki, i = 2,3,...,m-l. 



(3) 



with Kg suitable real numbers. 

The main idea underlying our construction is to rep- 
resent delta operators in logarithmic form, in terms of a 
suitable function. 

Definition 2 We call logarithmic representation of the 
delta operator {Ip the correspondence T -^r^ , that 
defines an isomorphism X between the space of shift- 
invariant operators and the space of functions f eT-L. 

The main definition of the Section is the following. 
Definition 3 We call generalized logarithm the function 



Logaix) 



1 



;fc„a;''", l,m<EZ, 



Notice also that the first of the two conditions ([2|) im- 
plies that 



Logcil) = 0. 



(6) 



Several examples of interesting logarithmic functions can 
be obtained by using the logarithmic representation. For 
instance, if we use the entropic parameter q, via the 
identification a = 1 — g, the Tsallis logarithm Q, Q 
corresponds to the discrete derivative of order r = 1 
A+ = 



Logrix) 



1-9 



(7) 



The Kaniadakis logarithm [34| is the indicator of the op- 
erator of order two A,, = : 



Logxix) = 



2k 



(8) 



(we put here cr = k in accordance with the standard 
notation) . 



III. GROUP ENTROPIES 

Motivated by the previous construction, we propose 
one of the central notions of this work. 
Definition 4. Consider a discrete probability distribu- 
tion {pi}i=i^... J normalized as 



w 



(9) 



We call group entropy the functional 

w 



Sg{p) ■■= k^PiLogci — ), 

Pi 



(10) 



I < m, m — I = r, x > 



(4) 



with the constraints i.e. the image of the opera- 

tor (QP under the isomorphism I. 

The following Lemma motivates the choice of the name 
"logarithm" for the function 
Lemma 1. The following property holds: 



lim Logcix) — In a:. 



(5) 



under the conditions 

Proof. The constraints ([l])-® ensure that, in the 
limit a 0, the discrete derivatives of the family ([!]) tend 
to the continuous derivative dx. If we put a; = e*, it im- 
plies that the function i Y^^=i 



^cm — 1 Y^"i 



tends to i = Inx when cr — > 0. 



where Logo denotes the generalized logarithm ^ with 
the constraints 0), (0), and k G M^. 

In physical contexts, we can typically identify k with 
the Boltzmann constant ks', otherwise, as in informa- 
tion theory, we tacitly assume k — 1. The reason for 
the denomination of group entropy for Sg comes from 
its connection with the universal formal group: it will 
determine the corresponding correlations for the class of 
physical systems under examination. 

As will be explained below, the freedom in the deter- 
mination of the set of constants km left by the conditions 
©, ^ can be used to impose the requirement of con- 
cavity, Lesche stability [35|, etc. for our group entropies. 

The entropies previously defined belong to the class of 
trace form entropies. This class is very general, but does 
not include other functional forms, like Renyi's entropy 
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[36| , also interesting in several applications. The classical 
Boltzmann-Gibbs entropy 



w 

Sb = -fc^p^lnpi 



(11) 



is obtained from ([T0| in the limit a ^ 0. The Tsallis and 
the Kaniadakis one correspond to the choices ([7]), ([5]). 
Let us now construct some new examples. Consider for 
instance the difference operators 



A 



/// 



-, A 
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p2_3_'j^_|_3^^— 1 rp — 2. 



^ _ T^-2T''+2T-2T~^+T~ 



and so on. The corresponding logarithms are 
a 

<J \ I I 
Consequently, we introduce the entropies 

N 



[40|. The fourth Khinchin axiom, regarding additivity, 
obviously does not hold in the present nonextensive con- 
text. Precisely, in our approach, the formula (|20p be- 
low, concerning the " composability" of a system, is no 
longer an axiom, but a property, coming naturally from 
our group-theoretical construction. 

Along these lines, in the recent work a classifica- 
tion of trace-form entropies has been recently proposed. 
By relaxing the fourth Shannon-Kinchin axiom, univer- 
sality classes of entropies are introduced and an explicit 
expression of them in terms of the incomplete Gamma 
function (Gamma entropies) is provided. 

Notice that there is a simple alternative way to derive 
the group entropies defined above. Indeed, the functions 
PU)) are characterized by the following interesting gener- 
ating formula: 



^G„. (p) - E (p''^ + , (12) 

i—l 

Sg.. b) ^ E P^ (p^'^ " Ip^ + - Pf) - (13) 



1=1 

N 



i=l 

(14) 



and so on. 

Here the roman sub-indices are used in order to distin- 
guish the logarithms and the associated entropies accord- 
ing to the order of the discrete operator they come from. 
The entropic forms ((T^ - P^ at the best of our knowl- 
edge are new. It would be desirable to produce an ax- 
iomatic formulation of the notion of group entrow, along 
the lines of Shannon-Khinchin- Abe's approach j37|-[38|. 
Observe that group entropies can be easily constructed 
in order to fulfill the first three of the classical Khinchin 
axioms [s^. Indeed, for a suitable choice of the set 
of coefficients {fc„} and at least in a suitable range of 
values of a, the general entropy (ITUl) 1) is continuous; 
2) reaches its maximum for the equiprobability distri- 
bution Pi — 1/W,i = 1,...,W; 3) satisfies the condi- 
tion SGipi,P2,---,Pw,0) = Sg{pi,P2,---,Pw), which 
amounts to say that the addition of an event of zero prob- 
ability does not affect the value of the entropy. It should 
be noticed that, although the entropy ([10]) is certainly 
continuous in the case of a finite number of microstates 
W , in general is no longer continuous for W = oo, when 
is not continuous the Boltzmann-Gibbs entropy either 



- k 



w 



Mo^)J2p'^ 



= Sc 



(15) 



Here A(a) stands for the operator (jT]), applied to the 
variable a. Formula (jlSp specializes in 



w 



Z — 1 



(16) 



Relation (jisp is inspired by a similar one, due to Abe 
^] for Tsallis' entropy, involving the Jackson derivative 

of the quantity Y^=\P^ ■ 

In the next section, the intimate connection between 
the proposed entropies and group theory will be clari- 
fied. In particular, the correlation laws underlying the 
proposed group entropies will be derived. 



IV. UNIVERSALITY CLASSES AND 
CORRELATION LAWS 

A. Main definitions 

We wish to propose a classification of statistical sys- 
tems in terms of universality classes related to group en- 
tropies. 

Given a commutative ring R with identity, and the 
ring i? {xi , a;2 , . . . } of formal power series in the variables 
Xi, Xi, . . . , with coefficients in i?, a commutative one- 
dimensional formal group over i? is a formal power series 
$ (x, y) e i? {x, y} such that [12] 

1) $ (x, 0) = $ (0, x) = X 
2) $($(x,?/),z) = $(a;,$(y,z)). 

When <i> (x, y) — ^ (y, x), the formal group is said to be 
commutative. The existence of an inverse formal series 
if {x) S R {x} such that $ {x, (p {x)) ~ follows from the 
previous definition. 

Perhaps the most general definition of trace form en- 
tropy comes from the theory of formal groups. 
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Definition 5. Consider the formal power series over 
the polynomial ring Q[ci, C2, ...] defined by 



G(t)=£c, 



(17) 



i=0 



with Co = 1, called formal group exponential. Let F 
he the compositional inverse of |i7| ); 



■i + l 



(18) 



so that G {F (t)) = t. We have 70 — 1,71 

3„2 „ 
2^1 — C2 



-ci,72 



The hazard universal formal group law flS] 

(19) 



is defined by the formal power series 

$(S1,S2) =G(i^(si)+F(s2)) 



Let us analyze the structure of the correlation law 
among subsystems for the family of entropies (1101) . i.e. 
their " composability" property. Assume that S is an ab- 
stract statistical system (physical, biological, etc.), com- 
posed by two independent subsystems A G S and B C S. 
A general property of the group entropy pUj) of S is non- 
additivity. Precisely, the following result holds. 

Theorem 1 The group entropy ilO\) satisfies the follow- 
ing nonadditive property: 



SG{A + B) = ^SGiA),SGiB)) 



(20) 



Proof. It it easy to prove that eq. ([20l) is true for the 
group entropy Sq if and only if it holds for the group 
logarithm Logcix) as well. If we use the exponential 
representation x e*, we obtain that Logcix) = G{t). 
Since t = G-^(s) := F{S), the relation G{ti + ^2) = 
G{F{si) + F{s2)) holds, which is the thesis. 

As a natural consequence of the previous result, a huge 
class of deformed algebraic structures and calculi closely 
connected both with the classical one (i.e. the algebra of 
real numbers) and the standard q-calculus can be derived 
from formal group laws. 

Definition 6. The generalized sum of two numbers x 
and y is given by the universal formal group law il9\} 



a; ®7 y = $ (a;, y) . 



(21) 



Here 7 is the set of parameters appearing in yl 

Remark 1. The Definition 4 of Group Entropy can 
be easily generalized to the case when the group expo- 
nential is indeed not simply a function of e* (as in Tsallis' 
case and the other ones considered above) , but a generic 
formal series of the type (|17|) . In this case we will talk 
about the universal group entropy. In the following, a 
physical example when this more general situation is con- 
templated is discussed. 

We propose here a possibly new definition of universal- 
ity classes for statistical systems. Essentially, it allows to 



identify systems sharing the same correlation law among 
their subsystems. 

Definition 7. A universality class of statistical sy.s- 
tems is a set of systems that satisfy the following proper- 
ties. 

• The correlation law between two independent sub- 
systems of a given system is expressed by the formal 
group law \19\) . 

• The thermo statistics associated is governed by the 
entropy constructed .starting from the corresponding 
group logarithm and exponential. 

As a matter of fact, once F and G are known, the 
entropy associated can be easily deduced, as shown in 
the subsequent discussion. 



B. Some relevant universality classes 

The simplest example is the Boltzmann-Gibbs univer- 
sality class. The entropic functional for this class is the 
Boltzmann-Gibbs entropy (|lip. The composition law 
(PT|) is defined by the choice G{t) — t, and the same 
for F. We get: 



X ®j y ^ X -\- y. 



(22) 



i.e. the additive formal group law. 

The Tsallis universality class corresponds to the choice 



Grit) = 



e"^ - 1 



for the group exponential, with the inverse 

Fr{s) = -ln(l + crs). 
a 

The related g-calculus is defined by 

x®qy = x + y+{l- q)xy, 



(23) 



(24) 



(25) 



(with (7 = 1 — 9) , which is the multiplicative formal group 
law. 

For the Kaniadakis universality class, we obtain 



GK{t) 



2a 



(26) 



for the group exponential. Its inverse is 

F^{s) = -\n{sa+Vs^<y^ + l)- (27) 

(T 

We have (by putting a — k) 

x®ky^ x\/l + k^y'^ + y\/l + k'^x'^, (28) 

which represents a specific realization of the Euler formal 
group law for elliptic integrals. Besides, as is well known. 
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it coincides with the composition law of relativistic mo- 
menta in special relativity. 

An example of entropy belonging to the more general 
class, defined in Remark 1, when the group logarithm 
is not of the form (|4]) but possesses a general expansion 
of the type (llSp . is Abe's entropy. It is related to the 
following logarithmic functional ([42|) 



LogA{x) 



a — a 



(29) 



By using the previous considerations, we can eas- 
ily generalize the previous logarithm by introducing the 
two-parametric functional 



b ' 



(30) 



which reproduces Abe's one fora = (T — 1,& = it^^ — 1. 
It has been already considered in the Borges-Roditi con- 
struction of an entropic functional [i^. In this case, the 
related group exponential, obtained by using the isomor- 
phism X, reads 



GA(t) 



a — b 



(31) 



The formal group corresponding to (1311) . giving the in- 
teraction rule for this class, is known in the literature as 
the Abel formal group, defined by p3 | 

$^(a;, y)=x + y + (3ixy + ^|3^ {xf - x'y) . (32) 

The coefficients /3„ in (|32|) can be expressed as polyno- 
mials in a and b (see Proposition 3.1 of 44]): 



I3n 



(-1)' 



n!(n — 1) 



- II [la + jb). 



(33) 



Concerning the algebraic structure of the theory, ob- 
serve that we can introduce a new multiplication law, 
inspired by the previous construction. 
Definition 8. Given two real numbers x and y, the prod- 
uct X ® y is defined by the relation 



Logcix ® y) = Logcx + Logay. 



(34) 



However, with these composition laws we do not get a 
priori standard algebraic structures: as has been already 
noticed for the specific example of the Tsallis class, there 
is no guarantee that the distributivity property be satis- 
fied. 



C. An interesting physical example 



Very recently, in |ll| a system of N over-damped in- 
teracting particles moving in a narrow channel has been 
studied. The equations for the velocities of the particles 
are 



E7( 



P{l^.t)+V{7t,t) (37) 



where vt is the velocity of the ith particle, ~f ( 
is a short-range repulsive particle-particle interaction, fj, 
is the effective viscosity of the medium, F'^{l^i) is an ex- 
ternal force, r]{ri,t) is a thermal noise with zero mean 
and variance < 77^ >= UbT / ^. One of the main results 
of [ij is that, for intermediate temperatures of the ther- 
mal bath in which the system is immersed, the entropy 
of the system is given by a linear combination of Tsal- 
lis entropy for q = 2 and the Boltzmann-Gibbs entropy. 
The novel type of thermostatistics proposed by these au- 
thors reveals the need for a generalization of the entropic 
functionals commonly used to include new ones inspired 
by concrete applications. From this point of view, the 
notion of group entropy provides a simple and unifying 
approach to this issue. It is easy to see that the example 
[111 ] can be easily accomodated in the framework previ- 
ously proposed. Indeed, the group exponential is 



Git) = at + b- 



Q-l 



(38) 



Note that this case corresponds to the more general situ- 
ation discussed in the Remark 1, and can be immediately 
generalized to any linear combination of known group en- 
tropies. We get 



w 



Soit) = [Pilnpi +Pi(l -Pi)] 



(39) 



We recover easily the known cases. 

i) For the case of the Boltzmann class, x®y = xy, i.e. 
the multiplication (l34l) reduces to the standard pointwise 
multiplications of real numbers. 

ii) For the Tsallis class, we have [1^1 



x<^qy=[x^ + y' « IJ 
Hi) For the Kaniadakis class, we obtain [2£ 



xi^kV ^ j; sinh 



—arcsinh (kx) arcsinh {xy) 
k 



(35) 



(36) 



V. THE THERMODYNAMICAL PROPERTIES 
OF THE THEORY: LEGENDRE STRUCTURE 
AND H THEOREM 

A natural question is what thermal statistics come 
from the generalized entropies discussed above. In this 
Section we address this problem from a formal point of 
view. We show that the Legendre structure of classical 
thermodynamics for a system in a stationary state would 
be preserved by any of the extensions which can be ob- 
tained within our mathematical framework. Other issues. 



7 



as possible generalizations of the zeroth law of thermody- 
namics are not addressed. Essentially, here we shall 
discuss the maximization of group entropies under appro- 
priate constraints: we advocate a _jgeneralized maximum 
entropy principle, following (47| . (isj . 

First, consider the microcanonical ensemble for an iso- 
lated system in a stationary state. In this case, the only 
constraint is 



W 



(40) 



As a consequence, the optimization of S yields equal 
probabilities, i.e. pi — l/W,\/i. Therefore, we have 



Sg — kLogcW, 



(41) 



which reduces to the celebrated Boltzmann formula 
Sbg = fc In in the case of uncorrelated particles. Now 
we consider a generalized canonical ensemble, i.e. a sys- 
tem in thermal contact with a reservoir. Assume that 
Pi{ti) is a normalized and monotonically decreasing dis- 
tribution function of e^. We can think of the numbers 
ti as the values of a physically relevant observable, for 
instance the value of the energy of the system in its ith 
state. We define the internal energy U in a given state 
as 



U 



w 

E 



(42) 



Consider the variational problem of the existence of a sta- 
tionary distribution pi (e) . We introduce the functional 



L = Sg[p] 



E?'(^')-i 



-/3 



w 



^e^p^{e^)) - U 



(43) 

where a and /3 are Lagrange multipliers. By imposing the 
vanishing of the variational derivative of this functional 
with respect to the distribution pi, we get the stationary 
solution 



Pi 



E{-a - P{e, - U) 



(44) 



with Z = E{—a — p{ei — U), and E{-) is an invert- 

ible function. However, only in particular cases (e.g. for 
the Boltzmann, Tsallis, Kaniadakis, Borges-Roditi en- 
tropies) this function can be identified with the inverse 
of Logo, according to the analysis of the role of general- 
ized exponentials in thermodynamics performed in [48| . 
Nevertheless, for generalized entropies constructed as a 
realization of the universal formal group that no longer 
belong to the trace-form class, one can contemplate fur- 
ther cases in which E{-) can be set to be the inverse of 
Logo- 

Notice that a closed expression for the inverse of Logo 
can be analytically determined in very specific situations. 



since the inversion of a formal group logarithm would in- 
volve the solution of polynomial equations of high degree. 
Although we will keep the discussion at a formal level, 
however, we can assume that at least a numerical inter- 
polating solution, in several cases and for specific subsets 
of the space of parameters, be available. 

As usual, the parameter a can be eliminated by means 
of the constraint J2iPi^i)'s^(t) \p=p~ ^- perform 
the Legendre transform of LogdZ), we get the interest- 
ing relation 



LogG{Z) + l3U = Sg, 
from which we deduce immediately the relation 



dU 



1 



(45) 



(46) 



with T = 1//3. In this context, T plays the role of a local 
temperature, a priori function of space and time. In a 
nonequilibrium stationary state, the usual definition of 
temperature, as given by the zeroth law does not apply. 
The previous discussion also implies the generalized form 
of the free energy: 



F=U -TSc 



(47) 



A natural question is whether the group entropy sat- 
isfies an analog of the H-theorem. As has been shown in 
[49I I , it is possible to prove the validity of the H-theorem 
for a large class of entropic forms. Precisely, assume that 
the group logarithm (|4]) be an invertible function, and 
piecewise monotonic. Consider the master equation 



dpi 
dt 



w 

E 

i=i 



Ajipi) . 



(48) 



where Aij denotes the transition probability per unit 
time from the state j to the state i. If we assume the 
principle of microscopic reversibility [soj , which implies 
the relation 



4 ■ ■ — A ■ 

then, under the previous assumptions we obtain 



dS{p\ 
dt 



> 0. 



(49) 



(50) 



In order for an entropic functional to satisfy a maxi- 
mum entropy principle, it is sufficient to ascertain that 
it verifies the following concavity property. Consider two 
sets {pi} and {p[} of probabilities taken from the same 
set of W possibilities. Let A be a real parameter, satisfy- 
ing < A < 1. According to Q, define the intermediate 
probability law 



= \p, + {1 - \)p',. 



(51) 



A direct calculation shows that the entropies ((T^ - (ITil) . 
in a suitable interval of values of a, satisfy the condition 



s{{p':})>xs{{p.}) + {i^xsm). 



(52) 
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Another crucial aspect, for thermodynamical applica- 
tions, is the experimental robustness of the group entropy. 
It means that, given two distributions {pi}i=i....,w and 
{p'i}i=i,...,w whose values are slightly different. 



Ve 36 >0 s.t. \\p^p\\<6 



S[p] - S[p'] 



< e, 



where. 



(53) 

given a vector x, \\x\\i denotes the Li norm 
and Smax denotes the maximum value of the en- 
tropy. This property, also called Lesche stability [11] and 
equivalent to uniform continuity, is ensured under the 
hypothesis that the group exponential be at least piece- 
wise differentiable. We point out that this requirement is 
especially important for physical applications (for a re- 
cent discussion, see (EH); however it can be disregarded 
in other contexts, as, for instance. Information Theory. 



VI. GROUP ENTROPIES AS GENERALIZED 
KULLBACK-LEIBLER DIVERGENCES 

Following the classical approach by Shannon [s^l , [11] , 
we show here that group entropies can naturally be inter- 
preted as generalized information measures. This entails 
a proper definition of the functionals of the class (fTO|) on 
a continuous setting. As an important application, we in- 
troduce a generalization of the Kullback-Leibler relative 
entropy. This provides a very large set of measures of di- 
vergence between two different probability distributions, 
or alternatively of tests allowing to discriminate between 
two different hypotheses. Here, as in [52|, we propose 
a formulation of our approach in a measure-theoretical 
setting. 

Precisely, let (X, be a measure space, where as 
usual AT is a set, S a cr-algebra over X, and /i : S — IR+ 
a measure. A E-measurable function p : X M+ will 
be called a probability distribution function (p.d.f.) if 



pdpL = 1. 



(54) 



The probability measure induced by a pdf p is defined by 



PiE) 



p{x)dp(x), 



(55) 



In the following, we will assume that (AT, S, fj) is a cr- 
finite measure space, and that our probability measures 
are absolutely continuous with respect to fx. We will 
also identify functions differing on a /i-null set only. As 
a consequence of the classical Radon-Nikodym theorem, 
we will discuss on the same footing information measures 
coming from p.d.f. 's and from probability measures, since 
we can identify them up to a ^-nuU set, with P « fi. 

We can now propose the main definition of this Section. 
Definition 9. Given a a-finite measure space (X, I],/z), 
the group entropy of a pdf p is given by 



Sg{p) 



^pix)Loga^^ 



dn{x), 



(56) 



or equivalently in terms of a probability measure P abso- 
lutely continuous w.r.t. fi, 

Saip):^j^Loga[^)~\p, (57) 

provided the integral on the right exists. 

Here ^ denotes the Radon-Nikodym derivative of the 
measure P with respect to fi. Observe that we put k = 
1, as customarily in Information Theory. The Shannon 
entropy of the pdf p is obtained immediately from the 
previous definition: 



S{p)^ 



p{x) \iip{x)d^. 



(58) 



X 



In a similar way, we can introduce a generalization 
of the standard Kullback-Leibler relative entropy (KL) 
[53l |. that we call relative group entropy. In information 
theory, given two different probability distributions, the 
KL entropy is a measure of the expected number of ad- 
ditional bits required to code samples from P if, instead 
using a code based on P, we use a code based on Q. 
Definition 10. Let P and Q be two probability measures, 
and Q be absolutely continuous with respect to P. The 
relative group entropy is defined as 



Dg{p II Q) 



dP, 



(59) 



or equivalently, if fi is a measure, as 
Dg{p \\q)^ 



p{x)LogG f 44) (60) 



The previous definition implies the useful relation 

Sg{P) = DciP II (61) 

Our definition includes as a special case that proposed 
by^Tsallis in [53|. Also, it differs from that of Yamano 

Let us study some properties of the relative group en- 
tropy. First, consider a uniform distribution on a com- 
pact support of length W. We deduce that 

Daip, l/W) - LogGiW) - WSGip), (62) 

i.e. the RGE essentially measures the departure of 
a given group entropic functional from its value at 
equiprobability. 

If we impose that xLogG^x) is a convex function, the 
relative group entropies belong to the class of Csiszar /- 
divergence measures . In this case, the main property 
of the relative group entropy is a generalization of Gibbs' 
inequality. For simplicity, we will state it in the discrete 
case. 
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Theorem 3. Let {pi} and {qi} two sets of probabili- 
ties. Assume that xLogcix) is a convex function. Then 
the relative group entropy satisfies the inequality 



w 



Dg{P II Q)=Y.P.LogG->Q. 



(63) 



and the equality holds if and only if pi — qt for all i = 
l,...,W. 

Proof. It suffices to observe that, if the function 
(f{x) := xLogcix) is a convex one, we can use the classi- 
^alJenseninequahtyHa. Indeed, if we have a set of non- 
negative real numbers {pi,--- ,pw} and ,qw}, 
with ^ = 5i , X] 9i = ^2, then 

j:p.Loga^- ^S^Y: f ^(^) > = 



SiLoga^- 

02 



(64) 



Now, if 5i = 52 = 1, the inequaUty (|63|) foUows. Due 
to the condition LogQ{l) — 0, when pi — qi for aU i = 
1, . . . , we have DdP \\ Q) = 0. 

This resuh justifies the interpretation of relative group 
entropies, in a measure-theoretic setting, as criteria of 
information divergence. However, a priori we can also 
construct non Csizsar -type distances, for instance by re- 
laxing the above convexity condition or, for instance, by 
constructing generalized Chernoff a-distances [HH . Fur- 
ther study is in progress in this direction. 



VII. DIRICHLET ZETA FUNCTIONS 
ASSOCIATED WITH GROUP ENTROPIES 

In this section, we clarify the number-theoretic content 
of the previous theory. The main result can be stated as 
follows: provided some technical hypotheses are satisfied, 
there exists a Dirichlet zeta function associated with each 
universality class of a suitable type. In order to make the 
argument transparent, let us consider first the simplest 
nontrivial case, which is that of the Tsallis universality 
class. Quite interestingly, it is associated with the classi- 
cal Riemann zeta function. 

First, observe that Tsallis logarithm (7), under the 
exponential representation x ^ e*, corresponds to the 
group exponential - — jz^— 

Let r(s) = J^e-H'-^dt be the Euler F-function. 
Thus, if i?e s > 1, and g < 1, we have 



reciprocal of the following formal group exponential 
G(0 = - Vfe^e"""*, l,meZ, l<m, m-l^r, 

71 — 1 

(66) 

with the constraints ([2]) -([3]) and it > 0. We assume that 
1/G{t) is a C°° function over R+, rapidly decreasing at 
infinity. Compute (whenever possible) the formal expan- 
sion 



oo 



Thus, the function 



L(G,s) 



1 1 



F(s)a-i7o G{t) 



(67) 



-t'-^dt, (68) 



defined for Re s > 1 admits a holomorphic continuation 
to all complex values s 7^ 1. For Re s > 1 we define 
the Dirichlet series associated with the function L{s) := 
a^~^L (G, s) to be the series 



Cg(s) 



EOn 



(69) 



Assuming that G(t) > e"^* — 1, the series Cg{s) is abso- 
lutely and uniformly convergent for i?e s > 1, and 



EOn 



< 



00 



1 



n=l 



(70) 



- ([70)) can be found in 



The proof of the statements 

M- 

Clearly, each of the generalized zeta functions ([69)) is 
associated to a specific universality class, via the corre- 
sponding group exponential. Indeed, according to the 
construction discussed in the previous sections, assigning 
a group exponential is sufficient for determining com- 
pletely a universality class. 

Observe that the present construction is even more 
general, and can be proposed for logarithms different 
from that possessing the form ([55)) . In all these cases, un- 
der the above regularity hypothesis for G(i), a L-function 
can be constructed, but its representation in terms of a 
series of the form ()69p cannot be obtained in a simple 
way. 

We observe that the class of uncorrelated systems does 
not possesses an associated zeta function: from this point 
of view, the absence of correlation is trivial. In particular, 
it would be nice to understand the statistical mechanical 
interpretation of the zeroes of the family of zeta functions 
described here. 



1 



r(s) Jo 



1-9 



t'-'dt 



{1-qy 



-as). (65) 



VIII. CENTRAL LIMIT BEHAVIOUR AND 
OTHER OPEN PROBLEMS 



More generally, motivated by the previous example and 
by the definition of group entropy, let us consider the 



In this work, we have introduced the notion of group 
entropy, which emerges naturally as a unifying tool for 
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treating many theoretical aspects of generalized thermo- 
statistics and provides a nontrivial connection with num- 
ber theory. 

A wide spectrum of theoretical perspectives can be ex- 
plored. Here we suggest some open problems. 

A key result in probability theory is the Central Limit 
Theorem (CLT). In its standard version, it states that the 
mean of a large number of independent random variables 
identically distributed, with finite expectation value and 
variance, has the normal distribution as an attractor [59| . 
A central limit theorems for random correlated variables 
has been established [6^, 61 1. In the context of the 
present generalization of statistical mechanics, a natural 
question arises, which can be stated as follows. 

Consider a set of random variables, with any p.d.f, cor- 
related according to the law (HI]). Establish whether, un- 
der suitable conditions, an analog of the CLT holds for 
the universality classes described by the group entropy 
PH)) . Find the analytic expression of the attractor. An 
interesting problem is to establish the exact relation be- 
tween the present approach and the notion of " Gamma 
Entropy" recently proposed in (47j . i.e. under which 
conditions the universality classes described by Gamma 
entropies collapse into group entropies and vice versa. 
In addition, it appears interesting to study the role of 
general correlations laws in complex networks (especially 
scale-free networks [62i]), in biological complexity in 



temporal series analysis and in ecology, in relation with 
the study of bio-diversity |6J]. Also, it would be im- 
portant to deepen the comprehension of the dynamics 
of financial markets under nontrivial correlations (for a 
nonextensive approach see, e.g. (65j). An intriguing pos- 
sibility is to classify economical systems according to the 
universality class of correlations that govern them. 
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